Method for providing gui using motion and display apparatus applying the same

ABSTRACT

A method of displaying a three-dimensional (3D) graphical user interface (GUI) on a mobile phone, including controlling, by a processor of the mobile phone, a display of the mobile device to display a first face of a 3D GUI, the first face comprising a GUI menu of the GUI, and a second face of the 3D GUI, the second face comprising image information of the GUI; detecting, by a sensor of the mobile phone, a physical slanting of the mobile phone; and displaying the image information of second face of the 3D GUI as being slanted to correspond to the physical slanting.

This is a continuation application of U.S. patent application Ser. No.12/900,182, filed on Oct. 7, 2010, in the U.S. Patent and TrademarkOffice, which application claims priority under 35 U.S.C. §119(a) toKorean Patent Application No. 10-2009-0095189, filed on Oct. 7, 2009, inthe Korean Intellectual Property Office, the contents of which areincorporated herein by reference in their entireties.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally to a method for providing aGraphic User Interface (GUI) and a display apparatus applying the same,and more particularly, to a method for providing a GUI which displays amenu according to a detected motion and a display apparatus applying thesame.

2. Description of the Related Art

Due to a continued advancement of mobile technologies, many more mobiledevices with displays are available for use. In addition, displayapparatuses are now capable of providing a variety of functions. Forexample, a complex multimedia device integrating therein functions of aMotion Pictures Experts Group (MPEG) Layer Audio 3 (MP3) player, cameraand mobile phone are in high demand.

GUI technology has also been developed to keep pace with thediversification of display apparatuses, and to enable simple use of theprovided functions. Sensors are particularly developed to receivevarious user manipulations and to enable the users to input instructionsin a preferred manner, such as by touching a screen or by motion sense.

As such, GUIs provide graphics on a screen and are rapidly replacing theconventional button-based User Interfaces (UIs). Accordingly, there is aneed for a method to provide a GUI, with which users can easily use amenu on the functions of the display apparatuses.

SUMMARY OF THE INVENTION

The present invention has been made to address at least the aboveproblems and/or disadvantages and to provide at least the advantagesdescribed below. Accordingly, an aspect of the present inventionprovides a method for providing a GUI which displays a screen of aspecific face on a three dimensional (3D) GUI, and if a user'smanipulation is inputted when the screen of the specific face isdisplayed, displays the screen of at least one of the adjoining facescorresponding to the direction of the user's manipulation, and a displayapparatus applying the same.

According to the present invention, a method for providing a GUI of adisplay apparatus includes generating a 3D GUI constructed to displayseparate screens on a specific face and at least one adjoining facescontacting an edge of the specific face, displaying the screen of thespecific face, and if a user manipulation is inputted in a state thatthe screen of the specific face is displayed, displaying the screen ofthe at least one adjoining face that corresponds to a direction of theuser's manipulation.

The user's manipulation includes a slanting motion by which the displayapparatus is slanted in a specific direction, and displaying the screenof at least one face includes displaying the screen of at least one ofthe upward, downward, leftward and rightward faces that corresponds tothe direction of the slanting, according to a direction of themanipulation by the slanting motion.

The displaying the screen of the at least one face comprises displayingthe 3D GUI at an inclination in the direction of the slanting, todisplay the screen of at least one of the upward, downward, leftward andrightward faces that corresponds to the direction of the slanting.

The displaying the screen of the at least one face includes inputting astart manipulation, indicating an initiation of a manipulation byslanting motion, detecting for the slanting motion of the displayapparatus, and displaying a screen of at least one of the upward,downward, leftward and rightward faces that corresponds to the directionof the slanting, according to the direction of slanting motion asdetected.

The displaying the screen of the at least one face includes displaying ascreen of one of the upward, downward, leftward and rightward faces thatcorresponds to the direction of the slanting, if a manipulation by theslanting motion is inputted in one of upward, downward, leftward andrightward directions with reference to a screen of the displayapparatus.

The displaying the screen on the at least one face includes displayingscreens of two of the upward, downward, leftward and rightward facesthat correspond to the direction of the slanting, if a manipulation bythe slanting motion is inputted in one of diagonal directions includingleft-upward, left-downward, left-downward and right-downward directionswith reference to a screen of the display apparatus.

According to the present invention, a display apparatus includes a GUIgenerating unit which generates a 3D GUI constructed to display separatescreens on a specific face and at least one adjoining faces contactingan edge of the specific face, a display unit which displays the 3D GUI,and a control unit which controls so that, if a user manipulation isinputted in a state that the screen of the specific face is displayed,the screen of the at least one adjoining face that corresponds to adirection of the user's manipulation is displayed.

The specific face is one face of a rectangular parallelepiped, and theat least one adjoining face is an upward face, a downward face, aleftward face, and a rightward face which adjoin four edges of thespecific face.

The display apparatus additionally includes a motion detecting unitwhich detects a motion of the display apparatus, and the user'smanipulation includes a slanting motion by which the display apparatusis slanted in a specific direction, and the control unit controls sothat the screen of at least one of the upward, downward, leftward andrightward faces that corresponds to the direction of the slanting isdisplayed, according to a direction of the manipulation by the slantingmotion.

The control unit controls so that, if a start manipulation is inputted,indicating an initiation of a manipulation by slanting motion, accordingto the direction of the slanting motion as detected by the motiondetecting unit, a screen of at least one of the upward, downward,leftward and rightward faces that corresponds to the direction of theslanting is displayed.

The control controls so that, a screen of one of the upward, downward,leftward and rightward faces that corresponds to the direction of theslanting is displayed, if a manipulation by the slanting motion isinputted in one of upward, downward, leftward and rightward directionswith reference to a screen of the display apparatus.

The control unit controls so that the screens of two of the upward,downward, leftward and rightward faces that correspond to the directionof the slanting, are displayed, if a manipulation by the slanting motionis inputted in one of diagonal directions including left-upward,left-downward, left-downward and right-downward directions withreference to a screen of the display apparatus.

The separate screens of the specific face and the at least one adjoiningface contacting an edge of the specific face, include at least one of amenu screen, a content playback screen, and an application executingscreen.

According to an embodiment of the present invention, a method forproviding a GUI of a display apparatus which is capable of detecting amotion, includes inputting a manipulation by slanting motion withrespect to the display apparatus, and displaying a menu on at least oneof upward, downward, leftward and rightward sides of a screen thatcorresponds to a direction of the manipulation by slanting motion, ifthe manipulation by slanting motion is inputted.

According to the present invention, a screen on a specific face isdisplayed on a 3D GUI, and if a user's manipulation is inputted in astate that the screen of the specific face is displayed, a screen of atleast one of adjoining face that corresponds to a direction of theuser's manipulation, is displayed. As a result, user is able to select adesired menu with increased ease and convenience.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features and advantages of the presentinvention will be more apparent from the following detailed descriptionwhen taken in conjunction with the accompanying drawings, in which:

FIG. 1 illustrates a mobile phone according to an embodiment of thepresent invention;

FIG. 2 is a flowchart of a method for providing a 3D GUI according to anembodiment of the present invention;

FIGS. 3A to 3C illustrate the process of displaying a menu on theleftward face according to an embodiment of the present invention;

FIG. 4 illustrates the structure of a 3D GUI according to an embodimentof the present invention;

FIG. 5 illustrates a mobile phone having a motion start button accordingto an embodiment of the present invention;

FIGS. 6A to 6C illustrate instances when the menu on the leftward faceis displayed, and instances when the menus on the leftward and upwardfaces are displayed, according to an embodiment of the presentinvention;

FIGS. 7A to 7D illustrate the process of selecting a subordinate menuusing the 3D GUI menu according to an embodiment of the presentinvention;

FIGS. 8A to 8D illustrate the process in which the user selects an itemdisplayed on the specific face according to an embodiment of the presentinvention;

FIGS. 9A to 9D illustrate the process of selecting an item of a menudisplayed on the leftward face according to an embodiment of the presentinvention;

FIGS. 10A to 10D illustrate the process of bookmarking on a menudisplayed on the rightward face, according to an embodiment of thepresent invention;

FIGS. 11 a to 11D illustrate the process of displaying the widget on thespecific face using the menu displayed on the leftward face, accordingto an embodiment of the present invention;

FIGS. 12A to 12D illustrate the process of moving the widget from thespecific face to the item of the menu displayed on the leftward face,according to an embodiment of the present invention;

FIGS. 13A to 13D illustrate the process of displaying icons on thespecific face in accordance with a direction viewed by the user,according to an embodiment of the present invention;

FIG. 14 is a flowchart illustrating the process of displaying a menu ona corresponding side of a two dimensional (2D) GUI environment, if amanipulation by slanting motion is inputted to the mobile phone,according to an embodiment of the present invention;

FIGS. 15A to 15C illustrate the process of displaying a menu on acorresponding side of a 2D GUI environment, if a manipulation byslanting motion is inputted to the mobile phone, according to anembodiment of the present invention;

FIGS. 16A and 16B illustrate the structure of a 3D GUI which displays anapplication execution screen and an application list according to anembodiment of the present invention;

FIGS. 17A to 17C illustrate the process of using the 3D GUI on whichapplication is displayed; and

FIGS. 18A and 18B illustrate the process in which the mobile phoneadjusts the direction in which the 3D GUI is displayed, according to thedirection viewed by the user.

DETAILED DESCRIPTION OF EMBODIMENTS OF THE PRESENT INVENTION

Embodiments of the present invention are described in detail withreference to the accompanying drawings. In the following description,the same or similar reference numerals may be used for the same orsimilar elements when they are illustrated in different drawings.Detailed descriptions of constructions or processes known in the art maybe omitted for the sake of clarity and conciseness.

FIG. 1 illustrates a mobile phone 100 according to an embodiment of thepresent invention. Referring to FIG. 1, the mobile phone 100 includes acommunication unit 110, an audio input unit 120, an audio output unit130, a motion detecting unit 140, a GUI generating unit 150, a touchdetecting unit 160, a storage unit 170, a display unit 180, and acontrol unit 190.

The communication unit 110 is connected to access an external device,such as the TV 100 (or mobile phone) via a mobile communication network,a wireless communication network, or the Internet. The mobilecommunication network herein may include the Global System for MobileCommunications (GSM) network, or Wideband Code Division Multiple Access(WCDMA) network. The wireless communication network is connected, forexample, by Bluetooth® or Zigbee®. The Internet is connected, forexample, over the wireless Local Area Network (LAN).

The audio input unit 120 receives user voice input and converts theuser's voice into audio data consisting of electric signals, andtransmits the converted audio data to the control unit 190.

The audio output unit 130 outputs the audio signal received from thecontrol unit 190 through a speaker or the like.

The motion detecting unit 140 detects movements of the mobile phone 100,such as a manipulation by slanting motion of the mobile phone 10. The‘slanting motion’ herein refers to a slanting of the mobile phone 100with reference to a predetermined plane. The motion detecting unit 140detects the angle and the direction of slanting as the information onthe manipulation by slanting motion. The angle of slanting herein refersto the angle between a predetermined face and the mobile phone 100. Thedirection of slanting herein refers to a direction to which the mobilephone 100 is slanted. Specifically, the direction of slanting mayinclude one of upward, downward, leftward, rightward, left-up,left-down, right-up and right-down directions.

The motion detecting unit 140 may be implemented as an accelerationsensor or a gyro sensor. The motion detecting unit 140 transmits theinformation regarding the detected manipulation by slanting motion tothe control unit 190.

The GUI generating unit 150 generates GUI to receive a user command. TheGUI generating unit 150 generates a 3D GUI to display menus on aspecific face and at least one face adjoining the edge of the specificface, respectively. That is, the GUI generating unit 150 generates 3DGUI based on five faces of a rectangular parallelepiped.

The 3D GUI herein displays menus on upward, downward, leftward andrightward faces each adjoining a specific face and edge adjoining thefour edges of the specific face of the rectangular parallelepiped. Thespecific face is a bottom face of the rectangular parallelepiped, whichhas the same size as that of the screen of the mobile phone 100.Additionally, the specific face corresponds to an area on which the GUImenu is displayed. The upward, downward, leftward and rightward facesmay display upper or lower menus of the menu displayed on the specificface, and also display icons which work as the shortcuts to thefunctions provided by the mobile phone 100.

As explained above, the GUI generating unit 150 generates the 3D GUI onwhich menus are displayed on a specific face and the adjoining faces,and transmits the generated GUI to the control unit 190.

The touch detecting unit 160 detects information on user's manipulationby touch. Specifically, the touch detecting unit 160 may be implementedas a touch screen to detect the user's manipulation by touch withrespect to the display screen. The touch detecting unit 160 transmitsthe detected information regarding the user's manipulation by touch tothe control unit 190.

The storage unit 170 stores therein programs to execute respectivefunctions of the mobile phone 100. The storage unit 170 may beimplemented, for example, as a hard disk or non-volatile memory.

The display unit 180 displays an image to provide the functions of themobile phone 100, and displays GUI for manipulation of the user on thescreen. Specifically, the display unit 180 displays the 3D GUI, in whichthe menus are displayed on the specific face and adjoining faces,according to the user's manipulation.

The control unit 190 controls the overall operation of the mobile phone100. The control unit 190 controls in response to the user'smanipulation inputted when the menu on the specific face is displayed,so that the menu on at least one side surface that corresponds to thedirection of the user's manipulation is displayed on the screen. Thatis, if the user's manipulation is inputted when the menu on the specificface is displayed, the control unit 190 controls so that the menu on atleast one face that corresponds to the direction of the user'smanipulation is displayed on the screen.

If the user's manipulation corresponds to the manipulation by slantingmotion of the mobile phone 100, the control unit 190 controls so thatthe menu on at least one of the upward, downward, leftward and rightwardfaces that corresponds to the direction of slanting, is displayed. Thecontrol unit 190 controls so that the 3D GUI is slanted in the directionof slanting to thereby display the menu on at least one of the upward,downward, leftward and rightward faces that corresponds to the directionof slanting.

The angle of slanting by the 3D GUI is in proportion to the angle ofslanting by the mobile phone 100. Accordingly, the control unit 190provides the user with an effect as if the 3D GUI is physically slanted.

If a start manipulation to initiate the manipulation by slanting isinputted, the control unit 190 may control so that the menu on at leastone of the upward, downward, leftward and rightward faces thatcorresponds to the direction of slanting is displayed according to thedirection of slanting. The ‘start manipulation’ is the reference of themanipulation by slanting. That is, the face of the mobile phone 100 atthe time of input of the start manipulation becomes the reference plane(i.e., 0 degree) of the manipulation by slanting. The start manipulationmay include pressing on a specific button on the mobile phone 100, ortouching of a specific icon.

If a manipulation by slanting is inputted to one of upward, downward,leftward or rightward directions with respect to the screen of themobile phone 100, the control unit 190 controls so that the menu on oneof the upward, downward, leftward and rightward faces that correspondsto the direction of slanting is displayed. Specifically, if amanipulation by slanting is inputted in the upward direction withrespect to the screen, the control unit 190 controls so that the menu onthe upward face is displayed. If a manipulation by slanting is inputtedin the downward direction with respect to the screen, the control unit190 controls so that the menu on the downward face is displayed. If amanipulation by slanting is inputted in the leftward direction withrespect to the screen, the control unit 190 controls so that the menu onthe leftward face is displayed. If a manipulation by slanting isinputted in the rightward direction with respect to the screen, thecontrol unit 190 controls so that the menu on the rightward face isdisplayed.

Furthermore, if the manipulation by slanting is inputted in one ofleft-upward, left-downward, right-upward, and right-downward directionswhich are diagonal with respect to the screen of the mobile phone 100,the control unit 190 controls so that the menus on two faces thatcorrespond to the direction of slanting are controlled. Specifically, ifthe manipulation by slanting is inputted in the left-upward directionwith respect to the screen, the control unit controls so that the menuson the leftward and upward faces are displayed. If the manipulation byslanting is inputted in the left-downward direction with respect to thescreen, the control unit controls so that the menus on the leftward anddownward faces are displayed. If the manipulation by slanting isinputted in the right-upward direction with respect to the screen, thecontrol unit controls so that the menus on the leftward and upward facesare displayed. If the manipulation by slanting is inputted in theright-downward direction with respect to the screen, the control unitcontrols so that the menus on the rightward and downward faces aredisplayed.

As explained above, the mobile phone 100 displays the 3D GUI with menuson the specific face and the adjoining faces, and controls the 3D GUIaccording to the manipulation by slanting. Accordingly, the user is ableto see new menus by simply slanting the mobile phone 100, and useotherwise complicated menus with increased ease.

FIG. 2 is a flowchart of a method for providing a 3D GUI according to anembodiment of the present invention.

At S210, the mobile phone 100 generates a 3D GUI with menus displayed ona specific face and at least one face adjoining the specific face.Specifically, the mobile phone 100 generates the 3D GUI establishedbased on five faces of a rectangular parallelepiped. The 3D GUI includesthe menus displayed on the specific face and upward, downward, leftwardand rightward faces that adjoin the four edges of the specific face,which may be the bottom face of the parallelepiped having the same sizeas that of the mobile phone screen. The specific face may be the area todisplay the general GUI menu. Compared to the specific face, the upward,downward, leftward, and rightward faces may display upper or lower menuswith respect to the menus on the specific face, or display icons of theshortcuts to the functions provided by the mobile phone 100.

At S220, the mobile phone 100 displays the menu on the specific face onthe screen. At 5230-Y, if a user inputs a manipulation by slanting in astate that the menu on the specific face is displayed, at 5240, themobile phone 100 displays the menu on at least one face that correspondsto the direction of the manipulation by slanting. In order to displaythe menu on at least one of the upward, downward, leftward and rightwarddirections that corresponds to the direction of slanting, the 3D GUI isslanted to the direction of slanting.

The angle of slanting by the 3D GUI is in proportion to the angle ofslanting by the mobile phone 100. Accordingly, the control unit 190provides an effect as if the 3D GUI is physically slanted.

Furthermore, if a start manipulation is inputted to initiate themanipulation by slanting, the mobile phone 100 starts detecting for theslanting motion and may display the menu on at least one of the upward,downward, leftward and rightward faces that corresponds to the directionof slanting. The start manipulation is the reference of manipulation.That is, the face of the mobile phone 100 at the time of input of thestart manipulation becomes the reference plane (i.e., 0 degree) of themanipulation by slanting. The start manipulation may include pressing ona specific button on the mobile phone 100, or touching of a specificicon.

If a manipulation by slanting is inputted to one of upward, downward,leftward or rightward directions with respect to the screen of themobile phone 100, the control unit 190 controls so that the menu on oneof the upward, downward, leftward and rightward faces that correspondsto the direction of slanting is displayed. Specifically, if amanipulation by slanting is inputted in the upward direction withrespect to the screen, the control unit 190 controls so that the menu onthe upward face is displayed. If a manipulation by slanting is inputtedin the downward direction with respect to the screen, the control unit190 controls so that the menu on the downward face is displayed. If amanipulation by slanting is inputted in the leftward direction withrespect to the screen, the control unit 190 controls so that the menu onthe leftward face is displayed. If a manipulation by slanting isinputted in the rightward direction with respect to the screen, thecontrol unit 190 controls so that the menu on the rightward face isdisplayed.

Furthermore, if the manipulation by slanting is inputted in one ofleft-upward, left-downward, right-upward, and right-downward directionswhich are diagonal with respect to the screen of the mobile phone 100,the control unit 190 controls so that the menus on two faces thatcorrespond to the direction of slanting are controlled. Specifically, ifthe manipulation by slanting is inputted in the left-upward directionwith respect to the screen, the control unit controls so that the menuson the leftward and upward faces are displayed. If the manipulation byslanting is inputted in the left-downward direction with respect to thescreen, the control unit controls so that the menus on the leftward anddownward faces are displayed. If the manipulation by slanting isinputted in the right-upward direction with respect to the screen, thecontrol unit controls so that the menus on the rightward and upwardfaces are displayed. If the manipulation by slanting is inputted in theright-downward direction with respect to the screen, the control unitcontrols so that the menus on the rightward and downward faces aredisplayed.

By the processing explained above, the mobile phone 100 displays the 3DGUI with menus on the specific face and the adjoining faces, andcontrols the 3D GUI according to the manipulation by slanting.Accordingly, the user is able to see new menus by simply slanting themobile phone 100, and use otherwise complicated menus with increasedease.

FIGS. 3A to 3D illustrate a process of displaying a menu on the leftwardface when the specific face 310 of the 3D GUI is displayed on thescreen, according to the present invention. Referring to FIG. 3A, thespecific face 310 of the 3D GUI includes the GUI screen generallydisplayed on the mobile phone 100 when there is no slanting of themobile phone 100.

FIG. 3B illustrates the state when the mobile phone 100 is slantedslightly leftward. Referring to FIG. 3B, the leftward face 320 of the 3DGUI appears as the mobile phone 100 slightly slants leftward. FIG. 3Cillustrates the screen of the mobile phone 100 slanting further in theleftward direction in which case the entirety of the leftward face 320is displayed.

As explained above, the mobile phone 100 displays the face in thecorresponding direction when the manipulation by slanting is inputted toa specific direction.

FIG. 4 illustrates the structure of the 3D GUI 400 according to anembodiment of the present invention. Referring to FIG. 4, the 3D GUI 400is implemented as a rectangular parallelepiped having five faces.

If the 3D GUI 400 slants upward in a state that the specific face 410 ofthe 3D GUI 400 is displayed, the upward face 420 is displayed. If the 3DGUI 400 slants downward in a state that the specific face 410 of the 3DGUI 400 is displayed, the downward face 430 is displayed. If the 3D GUI400 slants leftward in a state that the specific face 410 of the 3D GUI400 is displayed, the leftward face 430 is displayed. If the 3D GUI 400slants rightward in a state that the specific face 410 of the 3D GUI 400is displayed, the rightward face 450 is displayed.

Accordingly, the mobile phone 100 generates a 3D GUI constructed basedon the five faces of the rectangular parallelepiped, and displays thegenerated 3D GUI on a screen.

FIG. 5 illustrates a mobile phone having a motion start button 500thereon according to an embodiment of the present invention. Referringto FIG. 5, if the user presses the motion start button 500, the mobilephone 100 starts detecting for motion with respect to the current planeof the mobile phone 100 as the reference plane. Accordingly, the mobilephone 100 perceives the manipulation by slanting.

Although the mobile phone 100 is illustrated in FIG. 5 as it includesthe motion start button 500, the mobile phone 100 may perceive thebeginning of the motion based on other types of manipulation.

FIGS. 6A to 6C illustrate the displaying of the leftward menu and ofdisplaying the leftward and upward menus concurrently, according to thepresent invention.

FIG. 6A illustrates an instance when the menu is displayed on thespecific face and the mobile phone 100 is not slanted. In this state, ifa manipulation by slanting in leftward direction is inputted to themobile phone 100, the mobile phone 100 displays the menu on the leftwardface 610 as illustrated in FIG. 6B.

If a manipulation by slanting in left-upward direction is inputted tothe mobile phone 100, the mobile phone 100 displays the menu on theleftward face 610 and the menu on the upward face 620 concurrently asillustrated in FIG. 6C. Accordingly, in response to a manipulation byslanting in the diagonal direction, the menus on two faces are displayedconcurrently.

FIGS. 7A to 7D illustrate the process of selecting a lower menu usingthe 3D GUI menu according to an embodiment of the present invention. Themenu has a hierarchy structure which includes a first level, a secondlevel, a third level, and a fourth level.

Referring to FIG. 7A, if a user slants the mobile phone 100 rightwarddirection from a state that the mobile phone 100 displays the menu onthe specific face 700 of a first level, as illustrated in FIG. 7B, amenu in the second level is displayed on the rightward face 720 as thesubordinate menu to the first level.

In the state illustrated in FIG. 7B, if the user selects one item fromthe menu in the first level, as illustrated in FIG. 7C, the menu in thesecond level which is subordinate menu to the selected item, isdisplayed on the specific face 700. The menu in the first level isdisplayed on the leftward face 710, and a menu in the third level isdisplayed on the rightward face 720. The ‘third level’ herein refers tothe subordinate menu of the menu in the second level.

In the state illustrated in FIG. 7B, if the user selects one item fromthe menu in the first level displayed on the rightward face 720, asillustrated in FIG. 7D, the menu in the third level which is subordinatemenu to the selected item, is displayed on the specific face 700. Themenu in the second level is displayed on the leftward face 710, and amenu in the fourth level is displayed on the rightward face 720. The‘fourth level’ herein refers to the subordinate menu of the menu in thethird level.

As explained above, using the 3D GUI in the rectangular parallelepipedshape, the user is able to select the upper or lower menus with respectto the menu currently displayed on the specific face.

FIGS. 8A to 8D illustrate the process in which the user selects an itemdisplayed on the specific face, according to an embodiment of thepresent invention.

FIG. 8A illustrates a state in which icons 801 of the main menu aredisplayed on the 3D GUI of the screen of the mobile phone. In thisstate, if a manipulation by slanting in leftward direction is inputtedto the mobile phone 100, as illustrated in FIG. 8B, the leftward face810 of the 3D GUI is displayed.

Referring to FIG. 8B, in response to the selection of a camera icon 805by the user, all the icons except the camera icon 805 move to theleftward face 810 as illustrated in FIG. 8C. Referring to FIG. 8D, themobile phone 100 displays the icons 820 representing the subordinatemenus of the camera icon, on the specific face.

Through the process explained above, the mobile phone 100 displays thesubordinate menus of the user selected icon on the specific face 800,and displays the other non-selected icons on the leftward face 810.

FIGS. 9A to 9D illustrate the process of selecting an item on the menudisplayed on the leftward face 910, according to an embodiment of thepresent invention.

FIG. 9A illustrates the state where the main menu on the specific face900 of the 3D GUI is displayed on the screen of the mobile phone 100,which is not slanted. Referring to FIG. 9A, as the user selects themusic icon 905, the mobile phone 100 displays the music list 907 on thespecific face 900 as illustrated in FIG. 9B. If a manipulation byslanting is inputted in the leftward direction to the mobile phone 100,as illustrated in FIG. 9C, the mobile phone 100 displays the leftwardface 910 of the 3D GUI. At this time, there are icons of the main menu,i.e., upper menus, displayed on the leftward face 910.

In this state, if the user selects a phonebook icon 915 on the leftwardface 910 as illustrated in FIG. 9C, the mobile phone 100 displays thephonebook 920 on the specific face 900 as illustrated in FIG. 9D.

As explained above, the mobile phone 100 may display on the leftwardface 910 the upper menu of the menu currently displayed on the specificface 900. Accordingly, the user is able to see the upper menu easily bysimply slanting the mobile phone 100 in the leftward direction.

FIGS. 10A to 10D illustrate the process of bookmarking on a menudisplayed on the rightward face 1020 according to an embodiment of thepresent invention.

FIG. 10A illustrates a state in which the main menu on the specific face1000 of the 3D GUI is displayed on the screen of the mobile phone 100.Referring to FIG. 10A, if a user selects a music icon 1005, the mobilephone 100 displays a music list 1007 on the specific face 1000, asillustrated in FIG. 10B. If a manipulation by slanting in the rightwarddirection is inputted to the mobile phone 100, the mobile phone 100displays the rightward face 1020 of the 3D GUI as illustrated in FIG.10C. Bookmark icons are displayed on the rightward face 1020.

In the state explained above, if the user drags the fifth bookmark icon1025 on the rightward face 1020 to a specific item 1030, the mobilephone 100 indicates that the specific item 1030 is bookmarked asillustrated in FIG. 10D.

As explained above, the mobile phone 100 may display bookmark icons onthe rightward face 1020. Accordingly, by slanting the mobile phone 100in the rightward direction, the user may check the bookmarks easily.

FIGS. 11A to 11D illustrate the process of displaying the widget on thespecific face using the menu displayed on the leftward face 1100,according to an embodiment of the present invention.

FIG. 11A illustrates the state in which the main menu on the specificface 1100 of the 3D GUI is displayed on the screen of the mobile phone100. If the mobile phone 100 is slanted leftward, the mobile phone 100starts displaying the leftward face 1110 of the 3D GUI as shown in FIG.11B.

If the mobile phone 100 is slanted further in the leftward direction, asillustrated in FIG. 11C, the entire leftward face 1110 is displayed. Thewidget icons are displayed on the leftward face 1110. Referring to FIG.11C, if the user drags-and-drops the calendar widget 1115 to the area ofthe specific face 1100, as illustrated in FIG. 11D, the mobile phone 100displays the calendar widget 1115 on the specific face 1100.

FIGS. 12A to 12D illustrate the process of moving the widget from thespecific face to the item of the menu displayed on the leftward face1210.

FIG. 12A illustrates the state in which the main menu on the specificface 1200 of the 3D GUI is displayed on the screen of the mobile phone100. Referring to FIG. 12A, the calendar widget 1205 is displayedtogether on the specific face 1200. Referring to FIG. 12B, if the userdrags-and-drops the calendar widget 1205 to the leftward face 1210, thecalendar widget icon disappears from the specific face 1200 and isdisplayed on the leftward face 1210 as illustrated in FIG. 12C.Accordingly, referring to FIG. 12D, the calendar widget is not displayedon the specific face 1200.

As explained above, the mobile phone 100 may provide the widget usingthe leftward face 1210 of the 3D GUI.

FIGS. 13A to 13D illustrate the process of displaying icons on thespecific face with respect to a direction viewed by the user, accordingto an embodiment of the present invention.

FIG. 13A illustrates the menu screen which is not slanted. FIGS. 13B,13C and 13D illustrate the screen displayed when the mobile phone 100 isslanted at a gradually increasing angle in the leftward direction. Whenslanted in the leftward direction, the mobile phone 100 displays themenu screen slanted in the rightward direction in the 3D GUI tocorrespond to the leftward slanting thereof. Since the menu is slantedin the rightward direction, the user viewing the menu screen feels as ifthe menu is being viewed from the front.

As explained above, the mobile phone 100 displays the 3D GUI on thespecific face and the adjoining faces to the specific face of therectangular parallelepiped, and controls the 3D GUI based on themanipulation by slanting. Accordingly, the user is able to see new menusby simply slanting the mobile phone 100, and thus use an otherwisecomplicated menu with increased ease.

Hereinbelow, a 2D GUI will be explained with reference to FIGS. 14 to15C. FIG. 14 is a flowchart of the process of displaying a menu on acorresponding side of a 2D GUI, in response to an input of amanipulation by slanting of the mobile phone, according to an embodimentof the present invention.

At S1400, a manipulation by slanting motion is inputted to the mobilephone 100. At S1410, the mobile phone 100 displays the menu on at leastone of upward, downward, leftward and rightward sides of the screen ofthe mobile phone 100 that corresponds to the direction of themanipulation by slanting.

FIGS. 15A to 15C illustrate the process of displaying a menu on acorresponding side of a 2D GUI of the mobile phone, in response to aninput of a manipulation by slanting motion, according to an embodimentof the present invention.

FIG. 15A illustrates the screen of the mobile phone 100 on which themain menu 1500 is displayed. Referring to FIG. 15B, if the mobile phone100 is slanted gradually in the leftward direction, the mobile phone 100starts displaying the submenu 1510 on the left side. If the mobile phone100 is slanted further in the leftward direction, the mobile phone 100displays the entire submenu 1510 on the left side, as shown in FIG. 15C.

As explained above, the mobile phone 100 may provide a 2D GUIenvironment and display the menu on the side corresponding to thedirection of slanting, if a manipulation by slanting motion is inputtedto the mobile phone 100.

Although in the foregoing description the 3D GUI is implemented based onfive faces of the rectangular parallelepiped, this description is givenfor illustrative purposes only, and the 3D GUI may be constructed withtwo to four faces of the rectangular parallelepiped.

Furthermore, any GUI is implementable according to an embodiment of thepresent invention, provided that the GUI is capable of displaying a menubased on the user manipulation by slanting the mobile phone. In otherwords, the 3D GUI according to an embodiment of the present invention isapplicable to not only the rectangular parallelepiped, but also theother types of polygons.

Furthermore, the faces of the 3D GUI may display different contents orapplications, or the like.

Hereinafter, a 3D GUI on which an application execution screen isdisplayed will be explained with reference to FIGS. 16A to 17C, whichillustrate the mobile phone 100 held by a user in landscape orientation.

FIGS. 16A and 16B illustrate the structure of 3D GUI displaying anapplication execution screen and an application list, according to anembodiment of the present invention.

Referring to FIG. 16A, the mobile phone 100 displays thecurrently-executed application on the specific face 1600 of the 3D GUI.Additionally, based on the order of application arrangement, the mobilephone 100 displays the preceding application on the upward face 1610,and displays the following application on the downward face 1620. Themobile phone 100 displays the list of the currently-executedapplications on the leftward face 1630.

FIG. 16B illustrates a screen of the mobile phone 100 on which the 3DGUI with the above-explained structure is displayed.

FIGS. 17A to 17C illustrate the process of using the 3D GUI in FIG. 16B,on which application is displayed.

FIG. 17A illustrates an example in which a screen of executing theapplication ‘APP 2’ is displayed on the specific face 1600 on the screenof the mobile phone 100. In FIG. 17A, the specific face 1600 isdisplayed as a full screen.

If a user manipulates a specific button 1700 arranged on the mobilephone 100, the mobile phone 100 displays the 3D GUI on the screen asillustrated in FIG. 17B.

FIG. 17B illustrates an example in which the 3D GUI is displayed on thescreen of the mobile phone 100. The 3D GUI indicates ‘APP 1’ on theupward face 1610 as the application preceding ‘APP 2’ and ‘APP 3’ on thedownward face 1620 as the application following ‘APP 2’. The 3D GUIadditionally displays a list of applications on the leftward face 1630.

In the state explained above, if a manipulation by touch (i.e., stroke)is inputted in a downward direction as illustrated in FIG. 17B, themobile phone 100 displays the preceding application (i.e., applicationon the upward face 1610) as illustrated in FIG. 17C. Accordingly,referring to FIG. 17C, the 3D GUI indicates ‘APP 0’ on the upward face1610 as the preceding application to ‘APP 1’, and ‘APP 2’ on thedownward face 1620 as the following application to ‘APP 1’.

As explained above, the user is able to select or change thecurrently-executed application using the 3D GUI.

Furthermore, the mobile phone 100 may adjust the direction of displayingthe 3D GUI according to the direction viewed by the user.

FIGS. 18A and 18B illustrate the process in which the mobile phone 100adjusts the direction in which the 3D GUI is displayed, according to thedirection viewed by the user.

The mobile phone 100 detects the direction viewed by the user, to adjustthe displaying of the 3D GUI to correspond to the direction viewed bythe user. Specifically, the mobile phone 100 perceives the user's faceusing a camera (not illustrated) attached on the front of the phone 100,and detects the location of the user's face. The mobile phone 100includes the acceleration sensor and the gyro sensor, and using theaccelerator sensor and the gyro sensor, detects the posture of themobile phone 100. The mobile phone then detects the direction viewed bythe user, using the information regarding the user's face and theposture information of the mobile phone 100. The mobile phone 100adjusts the direction of the 3D GUI so that the direction viewed by theuser is in a perpendicular relationship with the specific face 1800 ofthe 3D GUI on which the main screen is displayed.

FIG. 18A illustrates the screen of the mobile phone 100 viewed by theuser from the right direction. Referring to FIG. 18A, if the user viewsthe screen from the right to the left, the mobile phone 100 displays thespecific face 1800 at a rightward inclination on the 3D GUI.

FIG. 18B illustrates the screen of the mobile phone 100 viewed by theuser from the left direction. Referring to FIG. 18B, if the user viewsthe screen from the left to the right, the mobile phone 100 displays thespecific face 1800 at a leftward inclination on the 3D GUI.

Since the mobile phone 100 displays the 3D GUI in accordance with thedirection viewed by the user who is watching the mobile phone 100 from aside, the user experiences an increased convenience in using the 3D GUI.Meanwhile, although the examples explained above employ the mobile phone100 as the display apparatus, this is written only for illustrativepurposes. Accordingly, any display apparatus can be implementedaccording to an embodiment of the present invention, provided that thedisplay apparatus is capable of providing a GUI. For example, a MP3player, a Point to MultiPoint (PMP), a personal data assistant, anetbook or a notebook may be implemented.

While the invention has been shown and described with reference tocertain embodiments thereof, it will be understood by those skilled inthe art that various changes in form and detail may be made thereinwithout departing from the spirit and scope of the invention, as definedby the appended claims.

What is claimed:
 1. A method of displaying a three-dimensional (3D)graphical user interface (GUI) on a mobile phone, the method comprising:controlling, by a processor of the mobile phone, a display of the mobiledevice to display a first face of a 3D GUI, the first face comprising aGUI menu of the GUI, and a second face of the 3D GUI, the second facecomprising image information of the GUI; detecting, by a sensor of themobile phone, a physical slanting of the mobile phone; and displayingthe image information of second face of the 3D GUI as being slanted tocorrespond to the physical slanting.
 2. The method of claim 1, whereinthe slanting comprises a slanting angle and a direction of the slanting.3. The method of claim 1, further comprising: determining a slanting tobe applied to correspond to the physical slanting.
 4. The method ofclaim 1, wherein the image information comprises a sub-menu GUI of theGUI menu.
 5. The method of claim 1, wherein the image information is asub-menu GUI of an application.
 6. The method of claim 1, wherein the 3DGUI is a 3D parallelpiped GUI.
 7. The method of claim 6, wherein thefirst face is a bottom face of the 3D parallelpiped GUI.
 8. The methodof claim 6, wherein the first face is a GUI screen generally displayedon the mobile phone when there is no slanting of the mobile phone.